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Abstract 

Quality indicators (Qls) measure the extent to which set targets are attained and provide a quantitative basis for achieving improvement in care 
and, in particular, laboratory services. A body of evidence collected in recent years has demonstrated that most errors fall outside the analytical 
phase, while the pre- and post-analytical steps have been found to be more vulnerable to the risk of error. However, the current lack of attention 
to extra-laboratory factors and related Qls prevent clinical laboratories from effectively improving total quality and reducing errors. Errors in the 
pre-analytical phase, which account for 50% to 75% of all laboratory errors, have long been included in the 'identification and sample problems' 
category. However, according to the International Standard for medical laboratory accreditation and a patient-centered view, some additional Qls 
are needed. In particular, there is a need to measure the appropriateness of all test request and request forms, as well as the quality of sample tran- 
sportation. The Qls model developed by a working group of the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) is a 
valuable starting point for promoting the harmonization of available Qls, but further efforts should be made to achieve a consensus on the road map 
for harmonization. 
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Introduction 

Numerous studies have been designed and con- 
ducted in the attempt to reduce the medical error 
rate; yet this issue still attracts public attention. It 
has been demonstrated that performance and 
outcome measures improve the quality of patient 
care. In particular, quality indicators (Qls) are valu- 
able tools for quantifying the quality of selected 
aspects of care by comparing them against de- 
fined criteria. Qls can thus support accountability, 
be of help in making decisions and setting priori- 
ties, thereby enabling a comparison to be made 
between providers and the effectiveness of inter- 
ventions (1). The recently released version of the 
International Standard for medical laboratories ac- 
creditation (ISO 15189: 2012) highlights the need 
to "establish quality indicators to monitor and 
evaluate performance throughout critical aspects 
of pre-examination, examination and post-exami- 
nation processes" (2). In addition, the Standard ISO 



15189:2012 stresses the point that "the process of 
monitoring quality indicators shall be planned, 
which includes establishing the objectives, meth- 
odology, interpretation, limits, action plan and du- 
ration of measurement". Moreover, it underlines 
the need to periodically review indicators to en- 
sure their continued appropriateness (2). 

The identification and use of effective Qls in all 
phases of the total testing process (TTP) is there- 
fore an essential requirement for laboratory ac- 
creditation, and for a valuable risk management 
strategy. Different Qls have been used in clinical 
laboratories in recent years in order to comply with 
the requirements of accreditation standards but, 
due to the different methods used for the identifi- 
cation and management of Qls, the results ob- 
tained by different laboratories cannot be com- 
pared. 
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The aim of the present paper is to describe and 
propose a new road map for the harmonization of 
Qls in the pre-analytical phase. 

Laboratory-associated errors 

Since the term 'laboratory-associated error' was 
coined a century ago (3), its meaning has com- 
pletely changed. Originally the term referred to 
defects in the analytical performance of the test it- 
self, in the so-called analytic phase. The first report 
on errors in laboratory testing, the seminal paper 
by Belk and Sunderman that paved the way to the 
development of external quality assessment pro- 
grams (EQA), focused solely on analytical errors, 
and identified a high error rate in the measure- 
ment of "simple" clinical chemistry analytes (4). 
The new millennium has hailed a formidable im- 
provement in the analytical phase with a ten-fold 
reduction in error rates, thanks to an improved 
standardization of analytic techniques and re- 
agents, advances in instrumentation and informa- 
tion technologies, as well as to the availability of 
better qualified and trained staff. This achieve- 
ment is also due to the development and intro- 
duction of reliable Qls and quality specifications 
for the effective management of analytical proce- 
dures (3). Internal quality control rules, as well as 
objective analytical quality specifications, and the 
availability of Proficiency Testing (PT)/EQA pro- 
grams have enabled clinical laboratories to mea- 
sure, monitor and improve their analytic perfor- 
mance overtime. 

Recently reported evidence indicates that most er- 
rors fall outside the analytical phase: the extra-an- 
alytical steps have been found to be more vulner- 
able to the risk of error (5-7). This calls for an evalu- 
ation of all the steps in TTP, whether or not they 
fall under the direct control of laboratory person- 
nel, the ultimate goal being to improve, first and 
foremost, quality and safety for patients. However, 
the current lack of attention to extra-laboratory 
factors, and related Qls, is in stark contrast to the 
body of evidence pointing to the multitude of er- 
rors that continue to occur, particularly in the pre- 
analytical phase. Achieving consensus on a com- 
prehensive definition of errors in laboratory test- 
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ing (8) was a milestone in reducing errors and im- 
proving upon patient safety, and in promoting the 
use of Qls. 

According to the Standard, the pre-analytical 
phase should be defined as "steps starting in 
chronological order, from the clinician's request 
and including the examination requisition, prepa- 
ration of the patient, collection of the primary 
sample, and transportation to and within the labo- 
ratory, and ending when the analytical examina- 
tion procedure begins" (2). The same document 
defines the analytical phase as a "set of operations 
having the object of determining the value or 
characteristics of a property" and the post-analyti- 
cal phase as "processes following the examination 
including review of results, retention and storage 
of clinical material, sample (and waste) disposal, 
and formatting, releasing, reporting and retention 
of examination results" (2). 

The pre-analytical phase 

In the definition of the pre-analytical phase made 
by the ISO 15189:2012, it is clearly recognized that 
there is a need to evaluate, monitor and improve 
all the procedures and processes in the initial 
phase of the TTP - the so-called "pre-pre-analytical 
phase"-, including test requesting, patient and 
sample identification, blood collection and sample 
handling and transportation. These procedures, 
which usually are neither performed in the clinical 
laboratory nor entirely fall under the control of 
laboratory personnel, are evaluated and moni- 
tored unsatisfactorily, often because the process 
owner is unidentified and the responsibility lies 
outside the boundary between the laboratories 
and clinical departments (3). 

There is therefore a need for a patient-centered 
approach that encompasses not only the tradi- 
tional on the procedures for sample acceptance/ 
rejection and specimen preparation, but also all 
the activities necessary to make a sample suitable 
for analysis, such as centrifuging, aliquotting, pi- 
petting, dilution and sorting (9). However, other 
fundamental procedures and processes (i.e. test 
requesting, patient and sample identification, 
sample handling and transportation to the labora- 
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tory), are error-prone, thus potentially putting pa- 
tient safety at risk (10). Moreover, the increasing 
trend towards consolidation of laboratory facilities 
has created a need to transport numerous of spec- 
imens from peripheral collection sites to the core 
laboratories (11), thus incurring a dramatic increase 
in the risk of errors in this step. 

Consequently, although traditional Qls address 
identification and sample problems, further as- 
pects affecting quality and safety must be consid- 
ered. In particular, the appropriateness of the test 
requesting and the completeness of the request 
forms are now recognized as key components in 
the provision of valid laboratory services, correct 
patient identification and sample collection being 
of fundamental importance in assuring total quali- 
ty (12). Moreover, there is still an urgent need for 
appropriate sample transportation conditions and 
adequate Qls. 

"Traditional" quality indicators for the 
pre-analytical phase 

According to current literature, pre-analytical er- 
rors should be grouped in two categories, accord- 
ing to identification and sample problems, as 
shown in Table 1. 

Data obtained following the development and use 
of Qls for the two main pre-analytical error catego- 
ries several national and international programs 
are available in the literature (13,14). 

For laboratory specimen misidentification, a rate 
of 1 in 1,000 opportunities has been reported, the 
most common categories of misidentification 
events being mislabeled (1%), mismatched (6.3%), 
and unlabeled specimens (4.6%), respectively (15). 



In general, misidentification occurs in 1 in 2,000 of 
specimens in transfusion medicine, while it occurs 
at a much higher rate (approximately 1 in 100) in 
clinical laboratory specimens. In fact, in transfu- 
sion medicine, technological improvements, im- 
proved education and training, and changes in 
policy and procedures have led to a significant re- 
duction in, but not the elimination of, misidentifi- 
cation errors (16). In clinical laboratories, however, 
problems persist and greater efforts should be 
made to heighten laboratory professionals' aware- 
ness of the pressing need to reduce this type of er- 
ror. In fact, sample misidentification can have sig- 
nificant consequences for patients as it may result 
in unnecessary diagnostic procedures, delays in 
diagnosis or treatment, and physical harm (17). 

The second category of traditional pre-analytical 
errors include sample problems. Hemolysis and 
samples in inadequate quantity are the primary 
cause of errors, the error rates for inpatients being 
significantly higher than those for out-patients 
(18). These observations are confirmed in a study 
reporting an error rate of 74.6% for inpatients and 
25.4% for outpatients (19). In the last few decades, 
data have been accumulated to identify the rates 
of sample errors (6-7,20-21), to record the differ- 
ences between rates for inpatients and those for 
outpatients, and to establish whether error rates 
are related to inadequate collection techniques 
and non-compliance with existing operational 
procedure guidelines (22). Differences in comply- 
ing with operational procedures and problems re- 
lated to inpatients' disease severity (e.g. need for 
numerous needle sticks, presence of severe burns, 
fragile skin and veins) may explain why the sample 
error rate is lower in outpatients with care opera- 
tors who are under direct laboratory control (20). 



Table 1. Pre-analytical errors grouped in relation to identification and sample problems. 

Identification Sample 

Unlabeled samples Hemolyzed 

Mislabeled samples Clotted 

Insufficiently labeled samples Icteric/lipemic 

Samples suspected of being from the wrong patient Incorrect filling level 

("wrong blood in tube") Inadequate quantity 

Irregularities in transfusion labeling requirements Lost/not received 

(e.g. signature of phlebotomist) Damaged during transportation and improperly stored 
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Laboratory staff has appropriate training and edu- 
cation on practice guidelines for blood collection 
and sample handling, thus maximizing the safety 
of these procedures. 

The use of pre-analytical workstations and tools 
such as serum indices in the laboratory has proven 
effective in decreasing most errors due to speci- 
men preparation, centrifugation, aliquoting, pipet- 
ting and sorting (3,5,21), while no significant de- 
crease in pre-pre-analytical mistakes (e.g. patient 
identification, unsuitable samples due to wrong 
collection procedures) has been achieved. 

Now that intra-laboratory procedures have been 
made safer, greater attention should be paid to 
extra-laboratory procedures, harmonization of 
test request practices, guidelines for blood collec- 
tion and sample transportation, the training and 
education of health care operators, and the use of 
serum indices to reduce pre-analytical errors (23). 

Harmonization ofpre-analytical quality 
indicators 

The initial steps of TTP are not undertaken in the 
clinical laboratory; nor are they performed entirely 
under the control of laboratory personnel, and 
they are more error-prone than other steps (24,25). 
Recently reported data on errors in the pre-pre- 
analytical phase underline that failures to order 
appropriate diagnostic tests, including laboratory 
tests, accounted for 55% of observed breakdowns 
in missed and delayed diagnosis in the ambulatory 
setting (26-28), and 58% of errors in the Emergen- 
cy department (29). In fact, most pre-pre-analytic 
laboratory errors involve some breakdown in the 
process, and both the laboratory and clinicians 
bear mutual responsibility for these errors and for 
developing safeguards that will prevent them. In 
particular, there is an emerging need to manage 
test demand to avoid unnecessary expenditure, 
reduce undue risk for patients and improve upon 
the use of laboratory services (30,31). The consen- 
sus achieved on the importance of advice for max- 
imizing the appropriateness of test requesting led 
to the inclusion of a specific requirement (clause 
5.4.2) in the ISO 15189 International Standard (2). 
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The steps undertaken to maximize appropriate- 
ness in test requesting must always be evaluated 
using indicators and long-term monitoring, which 
the laboratory should achieve by ensuring close 
interaction with the requesting physicians and ob- 
taining recognition from the appropriate stake- 
holders. Another key issue related to test request- 
ing, is the completeness of the request forms, a 
pre-requisite for the ultimate quality of laboratory 
results, as specified by the ISO 15189 International 
Standard (clause 5.4.3) (2). 

Qls should be used to measure and monitor all the 
critical activities in the pre-pre- (outside the labo- 
ratory) and pre-analytical (within the laboratory) 
phases. In particular, they should be considered 
useful tools for identifying, documenting and 
monitoring the following: 

a) quality of request forms, whatever their format 
(e.g. electronic or paper) and the manner in 
which requests are communicated to the labo- 
ratory; 

b) patient identification at the point of care, which 
is still an issue of fundamental importance as it 
is related to a high risk of errors with an impact 
on patient care although the specimen identifi- 
cation errors involving secondary tubes should 
be reduced by introducing pre-analytical work- 
stations; 

c) quality of biological specimens, particularly 
during and after transportation from collecting 
sites to the laboratory. 

Table 2 shows the Model of Quality Indicators 
(MQI) proposed by the IFCC Working Group "Labo- 
ratory Errors and Patient Safety" (IFCC WG-LEPS) 
for the pre-analytical phase. The MQI aims to be 
the "backbone" of the monitoring and the key to 
improving upon laboratory performances. How- 
ever, the effective adoption of Qls calls for a sound 
awareness in laboratory personnel of the impor- 
tance of Qls as a quality assurance tool for improv- 
ing the quality of laboratory service. The aware- 
ness and active involvement of the personnel is of 
crucial importance in overcoming problems relat- 
ed to data collection. Although, the implementa- 
tion and monitoring using Qls incurs extra work 
and may, at first, be time-consuming, these appar- 
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Table 2. Quality Indicators of the pre-analytical phase (order of priority: 1 = Mandatory; 2 = Important; 3 = Suggested; 4 = Valuable). 

Quality indicator Priority 

score 

a) Appropriateness of clinical request 

Percentage of "Number of requests without clinical question (outpatients) / Total number of requests (outpatients)" 2 

Percentage of "Number of inappropriate requests, with respect to clinical question (outpatients) / Number of requests reporting clinical 
question (outpatients) " 

Percentage of "Number of inappropriate requests, with respect to clinical question (inpatients) / Number of requests reporting clinical 
question (inpatients) " 

b) Patient identification 

Percentage of "Number of requests with errors concerning patient identification / Total number of requests" 1 

Percentage of "Number of requests with errors concerning patient identification, detected before release of results /Total number of 
requests" 

Percentage of "Number of requests with errors concerning patient identification, detected after issuing results /Total number of 
requests" 

c) Data entry of the request 

Percentage of "Number of outpatients requests with errors concerning physician identification / Total number of outpatients requests" 2 

Percentage of "Number of unintelligible outpatients requests /Total number of outpatients requests" 3 

Percentage of "Number of outpatients requests with errors concerning test input /Total number of outpatients requests" 1 

Percentage of "Number of outpatients requests with errors concerning test input (missing) / Total number of outpatients requests" 1 

Percentage of "Number of outpatients requests with errors concerning test imput (added) /Total number of outpatients requests" 1 

Percentage of "Number of outpatients requests with errors concerning test input (misinterpreted) / Total number of outpatients 
requests" 

Percentage of "Number of inpatients requests with errors concerning test input (missing) / Total number of inpatients requests" 1 

Percentage of "Number of inpatients requests with errors concerning test imput (added) /Total number of inpatients requests" 1 

Percentage of "Number of inpatients requests with errors concerning test input (misinterpreted) / Total number of inpatients requests" 1 

d) Sample identification 

Percentage of "Number of improperly labeled samples /Total number of samples" 1 

e) Sample collection 

Percentage of "Number of samples collected at inappropriate time / Total number of samples" 2 

Percentage of "Number of samples collected with inappropriate sample type / Total number of samples" 1 

Percentage of "Number of samples collected in inappropriate container /Total number of samples" 1 

Percentage of "Number of samples with insufficient sample volume / Total number of samples" 1 

f ) Transport of sample 

Percentage of "Number of damaged samples /Total number of samples" 1 

Percentage of "Number of samples transported at inappropriate time / Total number of samples for which transport time is checked" 1 

Percentage of "Number of samples transported under inappropriate temperature condition / Total number of samples for which the 
transport temperature is checked" 

Percentage of "Number of improperly stored samples /Total number of samples" 1 

Percentage of "Number of samples lost-not received / Total number of samples" 1 

g) Suitability of sample 

Percentage of "Number of samples with inadequate sample-anticoagulant volume ratio /Total number of samples with anticoagulant" 1 

Percentage of "Number of hemolyzed samples (hematology) /Total number of samples (hematology)" 1 

Percentage of "Number of hemolyzed samples (chemistry) / Total number of samples (chemistry)" 1 

Percentage of "Number of clotted samples (hematology) / Total number of samples with anticoagulant (hematology)" 1 

Percentage of "Number of clotted samples (chemistry) / Total number of samples with anticoagulant (chemistry)" 1 

Percentage of "Number of clotted samples (immunology) / Total number of samples with anticoagulant (immunology)" 1 

Percentage of "Number of hemolyzed samples (immunology) / Total number of samples (immunology)" 1 

Percentage of "Number of lipemic samples / Total number of samples" 1 

Percentage of "Number of unacceptable samples (microbiology) /Total number of samples (microbiology)" 1 

Percentage of "Number of contaminated blood cultures /Total number of blood cultures" 1 
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ent disadvantages are more than compensated by 
the reduced risk or errors, waste and operational 
repetition. Moreover, the method and time for 
data collection for each of the indicators shown in 
Table 2, should be firmly defined in order to clarify 
the events to check, and to harmonize the results 
obtained by different laboratories. 

The priority score to be assigned to each Ql is also 
of fundamental importance. The reason for identi- 
fying a priority scale for proposed Qls is to facili- 
tate their gradual introduction into routine prac- 
tice, by starting with a "mandatory" (score 1) and 
ending with a "valuable" (score 4) Qls score. "Man- 
datory" Qls ensure that the most critical activities 
(i.e. those incurring errors and risk of errors with 
potential negative clinical outcomes) are kept un- 
der control. In addition, "mandatory" Qls concern 
error-prone activities and/or procedures (i.e. ac- 
ceptance/rejection of hemolysed samples) that 
should easily managed by most clinical laborato- 
ries. Qls identified as "important" should be imple- 
mented in the laboratory when all "mandatory" 
Qls are just in use and, likewise, for other Qls con- 
sidered "suggested" ("advisable") and "valuable". 
Although important, the "valuable" Qls (priority 
scale 4), call for somewhat difficult data collection, 
and for laboratory staff acutely aware of the need 
for, and the importance of, Qls. The laboratories 
using Qls identified as "valuable" (in addition to 
"mandatory" and "Important" Qls) will raise their 
standard of quality management and TTP govern- 
ance. 

All Qls should be used in laboratories to provide 
evidence of compliance with essential require- 
ments of the ISO 15189 International Standard for 
assuring quality and accreditation of laboratory 
services, particularly as they are a tool for assuring 
risk management and promoting patient safety; 
however, the priority score should also help labo- 
ratories when difficulties encountered in practice 
dictate that a choice must be made. Therefore, 
while the entire set of Qls is essential both for 
clearly understanding their usefulness and for 
complying with the requirements of the ISO 15189 
International Standard, an individual laboratory 
should carefully select the most appropriate indi- 
cators to implement from the start, and over time. 
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As quality assurance is a never-ending journey, the 
implementation and monitoring of Qls should be 
considered an essential component in a continu- 
ous quality improvement program. Therefore, pro- 
gressive use should be made of Qls and monitor- 
ing should be encouraged so as to promote a val- 
uable quality system program, based on the famil- 
iarization with the rationale of Qls and the appro- 
priate method for data collection. 

In the journey towards quality and patient safety, 
Qls should be viewed as a formidable tool for: 

a) highlighting critical processes/activities; 

b) analyzing and solving the root causes of non 
conformity; 

c) reducing laboratory errors and the risk of er- 
rors; 

d) improving laboratory performances. 

The priority score (Table 2) described in the present 
paper can be considered a preliminary step in 
achieving harmonized guidelines following further 
consideration and discussion on the basis of differ- 
ent experiences made worldwide, by different lab- 
oratories. 

A road map towards harmonization 

Since a variety of Qls and terminologies are cur- 
rently used, the road map for harmonization 
should be based on sound criteria. In particular, 
Qls should be: 

a) patient-centered to promote total quality and 
patient safety; 

b) consistent with the definition of "laboratory er- 
ror" (specified in the ISO/TS 22367: 2008) and 
conducive to addressing all stages of the TTP, 
from initial pre-pre-analytical steps (test request 
and patient/sample identification) to post-post- 
analytical steps (acknowledgment of data com- 
munication, appropriate result interpretation 
and utilization); 

a) consistent with the requirements of the Inter- 
national Standard for medical laboratories ac- 
creditation (ISO 15189: 2012); 

a) suitable for promoting corrective/preventive 
actions. 
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Essential pre-requisites of objective and measura- 
ble Qls appear to be: 1) importance and applicabil- 
ity to a wide range of clinical laboratories world- 
wide; 2) scientific soundness with a focus on areas 
crucial to quality in laboratory medicine; 3) feasi- 
bility and the definition of evidence-based thresh- 
olds for acceptable performance; and 4) timeliness 
and possible utilization as a measure of laboratory 
improvement (10,11,32-35). Although the identifi- 
cation of valuable Qls is an essential step, other is- 
sues should be taken into consideration to assure 
a harmonized approach to the appropriate utiliza- 
tion of Qls in the pre-analytical phase. First and 
foremost, the standardization of the system for 
data collection and reporting plays a key role in as- 
suring the comparability of data collected by dif- 
ferent laboratories. This aspect prompted the IFCC 
WG-LEPS to split, in the MQI proposed, some Qls 
into different groups in order to facilitate the un- 
derstanding and collection of data (34). Second, 
most Qls cannot be managed without the collabo- 
ration and active cooperation of different care op- 
erators both inside and outside the laboratory. For 
example, the appropriateness of test requesting as 
well as the quality of collected samples can be im- 
proved upon only through the active involvement 
of requesting physicians, phlebotomists and nurs- 
es. The development and issue, at an international 
and national level, of practice guidelines for ap- 
propriate test requesting and blood collection 
should facilitate compliance and quality improve- 
ment. Third, another fundamental issue is the au- 
tomated collection of data on Qls, which obviates 
time-consuming procedures. The harmonization 
of Qls will be achieved by, above all, gaining con- 
sensus among experts in the field regarding cur- 
rent proposals, tools and steps required for a pre- 
liminary agreement, and then by defining actions 
to be taken for making the road map. 

Qls management will be validated only by means 
of international consensus on criteria and methods 
for management itself. The accreditation providers 
play a key role in assuring the correct interpreta- 
tion and application of the ISO 15189 requirements 
for Qls. The definition and the correct use of Qls, 
compliance with international recommendations, 
participation in appropriate EQA/PT programs 
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and, above all, the translation from measures to er- 
rors reduction must be analyzed and evaluated 
during the survey visits in a way that allows staff 
efforts to be rewarded, and the correct use of Qls 
to be encouraged. Awareness of the IFCC WG-LEPS 
project, the comparison between external data- 
bases, and between the performance of laborato- 
ries and peer organizations, will lead to the realis- 
tic definition of laboratory goals, with a conse- 
quent improvement in performance and the reali- 
zation and maintenance of excellence. 

Currently, on preparing the Consensus Conference 
on "Harmonization of quality indicators in labora- 
tory medicine: why, how and when?" (29), agree- 
ment has been achieved on the: a) value of Qls as 
an essential tool for accreditation and quality im- 
provement in laboratory medicine, as well as their 
role in benchmarking and external quality assur- 
ance programs; b) need for Qls to comply with the 
above-described fundamental criteria; c) value of 
the IFCC MQI as a starting point for discussing and 
finalizing a consensual proposal on Qls. 

In this context the future goals of the WG-LEPS 
concerning Qls could focus on promotion and di- 
vulgation of a set of consensually approved Qls, as 
well as on the collection of data from international 
laboratories in order to define the state of the art 
of laboratory errors, share the more appropriate 
corrective actions to be implemented and monitor 
the improvement achieved. 

Conclusion 

Indicators for laboratory performances in the TTP 
allow the quality of services to be measured and 
improved. According to the current definition of 
"error in laboratory medicine" all steps in the pre- 
analytical phase, including appropriateness in test 
requesting and request forms, patient and sample 
identification and quality of specimen transporta- 
tion, must be evaluated and monitored. Of course, 
the road map for harmonization of Qls will com- 
prise several steps and the identification of valua- 
ble Qls is a prerequisite in drawing it up, but the 
standardization of the system for data collection 
and reporting plays a key role in assuring the com- 
parability of data collected by different laborato- 
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ries. Moreover, few Qls can be managed without 
the collaboration and active cooperation of differ- 
ent care operators both inside and outside the lab- 
oratory. Therefore, although the harmonization 
process is in progress, further efforts must be 
made to raise the awareness of all stakeholders 
and to highlight the importance of Qls for improv- 
ing the quality of laboratory services and patient 



safety. In particular, a simplification of the current 
MQI with the identification of "mandatory" Qls ap- 
pears to be the key to allowing all laboratories to 
first select the most appropriate indicators and to 
gradually add further valuable Qls. 
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